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Abstract 

Parametrized families of density operators are studied. A generaliza- 
tion of the lower bound of Cramer and Rao is formulated. It involves 
escort density operators. The notion of (^-exponential family is intro- 
duced. This family, together with its escort, optimizes the generalized 
lower bound. It also satisfies a maximum entropy principle and exhibits 
a thermodynamic structure in which entropy and free energy are related 
by Legendre transform. 

1 Introduction 

The exponential family of probability distributions plays a central role in statis- 
tical mechanics, where it is called the Boltzmann-Gibbs distribution. In a previ- 
ous paper pQ the author has proposed a generalization of this family, involving 
the notion of deformed exponential functions. It is called the ^-exponential 
family because it involves a function 0, which is used to deform the exponential 
function. The present paper extends this work to the quantum-mechanical con- 
text, solving some of the difficulties resulting from working with non-commuting 
operators. Other difficulties that can arise (unbounded operators, operators that 
are not trace-class, ...) are not discussed at all. However, none of the latter tech- 
nicalities arise if the Hilbert space TL of quantum-mechanical wavefunctions is 
assumed to be finite dimensional. 

The motivation for this work is twofold. At one hand the canonical ensemble, 
although dominant, is not the only ensemble that occurs in statistical physics. 
Hence the present generalization might have practical applications. In fact, in 
nonextensive thermostatistics [2] , which involves the (/(-exponential family with 
4>{u) = u q , many such applications are claimed. But because of the generality 
of the present approach applications in statistics and in information theory are 
possible as well. At the other hand the formulation of a generalization might 



1 



provide new insights into the existing theory. Of particular interest is a better 
understanding of the problems around the definition of a quantum information 
manifold — see [3: for a recent attempt in this direction. Further work is needed 
both on the fundamental level and in the direction of finding applications. 

The paper is organised as follows. The next section generalizes the well- 
known lower bound of Cramer and Rao in quantum context. In Section 3 a 
sufficient condition for optimality of this lower bound is presented. Section 4 in- 
troduces the (^-exponential family of density operators. In Section 5 appropriate 
notions of entropy and of relative entropy are defined. Section 6 contains the 
obvious example of powerlaw distributions. In Section 7 the (^-exponential fam- 
ily is shown to satisfy a maximum entropy principle. The associated structure 
of Legendre transforms is revealed. The final section contains a short discussion 
of results. 



Escort density operators and the lower bound 
of Cramer and Rao 



Fix a Hilbert space TL. Recall that a density operator p of TL is a positive 
operator which is trace-class, with trace equal to 1. Let us consider families 
of density operators (pe)e^D, with parameters 9 — (9 1 ,- ■ ■ , 6 ) in some open 
domain D, subset of K . It is assumed that pg, seen as a function of its 
parameters 9, is sufficiently smooth so that its derivatives dpg/d9 k are well- 
defined operators. 

Consider two families of density operators (pe)eeD and {cro)e^D with com- 
mon parameter domain D. The two families are not related any further. Still, 
<rg is called the escort density operator of pg. Averages with respect to the two 
families of density operators are denoted by 



(A)g = TrpgA resp. [A]g = TragA. 



(1) 



For simplicity let us assume that ag is invertible. A generalized Fisher informa- 
tion g(9) is defined by 



9kl{0) = Tr 



1 dpg dpg 



89 k d9 l 



]_^Pe\ ( 1 dpg 
ag d9 k )\<7g d9 l 



fi 



(2) 



The A-by-A-matrix may contain complex entries. However, it is positive- 
definite. 

Let be given bounded self-adjoint operators Hi, ■ ■ ■ Hn and assume that a 
function F(9) exists for which 



dF 



k = l,---N. 



(3) 



In physical applications these operators are the macroscopic observables 
like Hamiltonian, total magnetization, particle number, ... . The parameters 
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9 k could be inverse temperature, external magnetic field, chemical potential 
(multipicd with inverse temperature), ... . The function F is minus the Massieu 
function (free energy multiplied with inverse temperature). The well-known 
lower bound of Cramer and Rao can now be generalized as follows 



Proposition For arbitrary complex numbers u k and v m is 



Mini 



[[H k Hi\ B - [H k ] g [H,] e ) 
\u m v n 92 F |2 



> 



(4) 



Proof The proof is based on Schwarz's inequality. Let 



x k = —-^t and Y k = H k - [H k ] e . 



Then one has 

u k v m [Y k Xl 
The l.h.s. evaluates to 



< u^lYkY^ev^X^De. 



(5) 



(6) 



u k v m [Y k Xl] e 



u k v r ' 



(H k - [H k ]e) 



u k v m Tr{H k -[H k ] t 



dp 1 
d6 m ~a~ g 

\ dp 



89* 



u k v m 



u k v m 



_d_ 



■(H k ) t 



d 2 F 



QQmQQk 



(7) 



Evaluation of the r.h.s. of l@ is straightforward. The result can be written as 
©■ 

□ 



3 Optimal escort families 



The lower bound J3J is said to be optimal if equality holds whenever u k = v k 
for all k. The exponential family is known to optimize the usual version of the 
lower bound of Cramer and Rao. escort density operators are allowed in the 
generalized lower bound Q . One can therefore expect that other families than 
the exponential one can optimize the lower bound provided that the escort fam- 
ily is chosen in a suitable way. Explicit examples of such families are discussed 
in the next section. Here, a sufficient condition for optimizing (JIJ is derived. 
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Proposition A sufficient condition under which the escort family {cre)e&D 
optimizes 0) is that there exists functions G(9) and Z(6) such that 



(8) 



Proof In order to show this point first notice that 



Tr (Jg cr 



d 

d8 k 



Tr ng = 0. 



Hence, © implies that 

One then calculates 

9ki(0) = 



Tr 



1 dp dp 
Ve'cWtW 



Z(d) 2 Trag [H k ]g - H k )[ [Hfo - H, 



On the other hand is, using (JSJ, 
8 2 F 



de k de l 



dG 



Z{6)([H k } 9 [H l } e -[H k H l ] 



Combining H11I12() gives 



u k v<{[H k H l ] g -[H k ]e[H l ]e) 



Tfmyn d 2 F 



(9) 



(10) 



(11) 



(12) 



(13) 



□ 



4 0-exp orient ial family 

Fix a positive nondecreasing function <f)(u), defined for u > 0. Use it to define 
another function, denoted exp^it), by the relations 



_d_ 

du 



exp (u) = (frfexp^u)) and exp (O) 



(14) 
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It is called a deformed exponential 0] . Its inverse ln^, (u) is a deformed logarithm. 

As before, a set of Hamiltonians Hi,- - ■ is fixed. The (/(-exponential 
family is defined in terms of these Hamiltonians by 

pg = exp (G(#) - 9 k H k ). (15) 

It is assumed that these operators pg are trace-class. Normalization Tr pg = 1 
determines the function G(9). 

Assume in what follows that the operators H%, ■ ■ ■ , Hn are two- by-two com- 
muting. This condition is needed for easy calculation of the derivatives dpg/d9 k . 
With this assumption there exists a common orthonormal basis of eigenvectors 
(ipn)n 

H k ip n = e k (n)ip n . (16) 
Then also pg is diagonal in the same basis and one has 

pg^ n = exp (g(9) - 9 k e k (n)^ n . (17) 

and 

= ( 18 ) 

Using this last result it is now straightforward to verify that the condition for 
optimality (JSJ) is satisfied with escort family and normalization given by 

*" = Wfj^ and z ( 9 )= Tl( t ) (Pe)- ( 19 ) 

5 Entropy and relative entropy functionals 

The ^-exponential family is the basis for formulating a generalized thermo- 
statistics j5j|6j. The derivation of the thermodynamical structure requires the 
introduction of an entropy functional I^,(p) and of relative entropy I^,(p\\a). 
The classical version of these quantities is found in pQ, although the way of 
presenting here is slightly different. 

An appropriate definition of entropy is 

I<p(p) = dxTr pln^xp) + / dx In^x), (20) 

Jo Jo 

Let us shortly analyse this expression. Introduce a function £ given by 

7TT = / dx 77~~T = - (M«) -- f dw \n^w)) (21) 
J <j>{xu) u\ uj J 
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Note that £(tt) is a positive increasing function of u. One has 

I*(p) = -Trpln c (p). (22) 

This expression looks familiar. In case of the natural logarithm is 4>{x) = x. This 
implies that also £(x) = x. Then (|20|) reduces to the conventional definition. 
From follows also that I^(p) > because ln^(p) < 0. 
Relative entropy, also called divergence, is defined by 

UipWa) = - I^p) - Tr (p - a) In^a). (23) 

Its basic property is the following. 

Proposition For any pair of density operators p and a is 

74p|H>0 (24) 

Proof From 

^-ula i u= [ dxx [ dv ( — ^— - 1 ) (25) 
du J J 1 \<p{xv) (f>{xu) J 

follows that the function f(u) = wln^(u) is convex. Hence Klein's inequality 
(see e.g. 0, 2.5.2) 



Tr (f (p) - f (a) -(p- a) f(a)j >0 

implies 

- I^p) + / (<r) - Tr (p - a) (ln 4 «r + > 0. 

The proof follows now from the identity 



(26) 



(27) 



it I 

ln , w = meU+ ___ ( 28 ) 

□ 

This result can be used to prove concavity of the entropy functional I${p). 

Corollary For any A satisfying < A < 1 is 

I^{Xa + (1 - A)p) > XU(cr) + (1 - A)J*(p). (29) 

Proof Let r = Act + (1 — A)p. Applying twice the proposition, in combination 
with definition l|23|) . one obtains 

J*(r) -/*(/>) > Tr(p-r)ln (r) 
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I^t) - I^a) > Tt(a-r)ln (r). (30) 
By taking a convex combination of these two expressions (|29[) follows. □ 



Finally, note that a short calculation shows that 



p + u' 



dp 



u«u l g kl (6)+o(u 2 )(31) 



d0 k J Z(9) ' 

This expression links relative entropy to generalized Fisher information. 



6 Example 

The obvious example is obtained by taking <j)(u) — u q , with 0<<7<2(<7 = 1 
corresponds with the standard case). In this case the notations ln g and exp q 
are used instead of ln^, resp. exp^. A short calculation gives 



In, (it) 



1-9 



(32) 



This particular definition of deformed logarithm has been introduced in [Hj . An 
easy integration gives £(it) = (2 — q)u q . Hence, in this case the functions <f> and 
£ differ only by a constant factor. The resulting entropy functional is 



hip) 



2-q 



Trp\n q {p) 



2-qq- 



T (Trp 2 ^-l) 



(33) 



This is, up to some changes in notation and a proportionality factor \/{q— 1), the 
entropy studied in the context of Tsallis' thermostatistics 0. The corresponding 
expression for relative entropy is 



h(p\W) 



(q-l){2-q) 



Tr {(q - l)a 2 -> - p 2 ~ q + (2 - q)pa l - q ) 



(34) 



7 Variational principle and duality 

Let us now show that the ^-exponential family satisfies a maximum entropy 
principle. 



Proposition Let (pe)e be a ^-exponential family of density operators with 
two-by-two commuting Hamiltonians Hi, ■ ■ ■ , Hpj, and with averages {H^g equal 
to the gradients of the potential F(9). There exists a constant F such that 

F{9) = F + mm{Trp9 k H k - I^p)}. (35) 
p 

The minimum is attained for p — p§. In particular, F{6) is a convex function of 
9 and p = pe maximizes Ij>(p) under the constraint that Tr 9 k pHk = Tr 9 k pgHk- 
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Proof From I(p\\pg) > follows 

< I<f>(pe) - I$(p) - Tr (p- p s )]n ( f,(p0). (36) 

But one has 

\n 4> {p e ) = G{6)-6 k H k . (37) 

Hence one obtains 

< I <t> {pe)-h{p)+ r Tt{p-pe)6 k H h . (38) 
This proves that for all p 

Tr p e 9 k H k - I^pg) < Tr pd k H k - I^p). (39) 
Next note that 

^ = me = £s(fmo-i*(p,)) (40) 

because one has 

-^uh(fie) = -^Trpeln^pg 

= ~ Tl { ln ' Pe + z(p7) Pe )w* ps 

d 

= -Tr (\ii <t> p e )— k -po 

= -Tr (G(9) — 6 l Hi) ^p-Pe 

= 0l w {Hl)e - (41) 

From 140(1 follows that there exists a constant Fq for which 

F(9)=F + 6 l (H l ) e -Ij > (pe) (42) 
holds for all 6. This finishes the proof. 

□ 



Introduce dual coordinates r/k (dual to 9 k ) by (see Q) 



They satisfy (use JHHEJ) 



°~ l =Z{9)([H k ]g[H l ]e-[H k H l ]e\=-^ 7 -g kl {9). (44) 
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These are the orthogonality relations between the two sets of coordinates. The 
dual of relation (|43|) is 

Indeed, using (f^Tl one obtains 

B f)0^ r) rP F 

where g kl is the inverse matrix of g^i . Next use to obtain l|45|) . 
Let E(t]) = I c j > (pe). Then one can write l|42(l as (putting Fq = 0) 

F(6) + E( v ) = 9 k m . (47) 

This shows that F(9) and E(n) are each others Legendre transform. This gen- 
eralizes the well-known result of standard thermostatistics that free energy is 
the Legendre transform of equilibrium entropy. 



8 Summary and discussion 

This paper introduces the notion of (^-exponential family of density operators 
pg. It depends on an arbitrary non-decreasing non-negative function (j) of the 
positive reals and on a set of Hamiltonians Hk ■ The analogy with the standard 
exponential family is enhanced by using the notion of deformed exponential 
function exp^,. The definition is motivated by showing that the (^-exponential 
family, together with a family of escort density operators, optimizes a generalized 
version of the well-known lower bound of Cramer and Rao. 

Generalized definitions of entropy l|20(l and of relative entropy (|23|l have 
been given. The definitions are such that the (^-exponential family of density 
operators satisfies a maximum entropy principle and that the function F{9) and 
entropy I^(pe) are each others Legendre transforms. The relation between F(9) 
and relative entropy is 

9 k Tr P H k - I^p) = F{6) + VHM- (48) 

The latter has the interpretation that free energy is minimal in equilibrium (i.e., 
when p ~ pg). 

The assumption has been made that the Hamiltonians Hk are two-by-two 
commuting. As a consequence, the quantum information 'manifold' (pg)g is still 
abelian. This is clearly too restrictive for a fully quantum-mechanical theory. 
Further work is needed to remove this restriction. 
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